Animated speech: research progress and applications
نویسندگان
چکیده
1 Background .................................................................................................................................1 1 Visible speech synthesis .........................................................................................................2 2 Illustrative experiment of evaluation testing ..........................................................................4 3 Data driven synthesis..............................................................................................................5 4 New structures and their control.............................................................................................6 4.1 Tongue, Teeth, Hard Palate, and Velum .........................................................................7 4.2 Controlling the Tongue ...................................................................................................8 4.3 Handling Collisions.........................................................................................................9 4.4 Tongue Shape Training ...................................................................................................9 4.5 Ultrasound Measurements .............................................................................................11 4.6 Synthetic Electropalatography.......................................................................................11 5 Asymmetry of the head ........................................................................................................12 6 Reshaping the canonical head...............................................................................................13 7 Training speech articuation using dynamic 3D measurements.............................................14 8 Some applications of electropalatography (EPG) to speech therapy....................................16 9 Development of a speech tutor .............................................................................................17 10 Potential applications............................................................................................................21 11 Acknowledgements ..............................................................................................................21 References .................................................................................................................................21
منابع مشابه
Visual Contribution to Speech Perception: Measuring the Intelligibility of Animated Talking Heads
Animated agents are becoming increasingly frequent in research and applications in speech science. An important challenge is to evaluate the effectiveness of the agent in terms of the intelligibility of its visible speech. In three experiments, we extend and test the Sumby and Pollack (1954) metric to allow the comparison of an agent relative to a standard or reference, and also propose a new m...
متن کامل2 Animated Speech: Research Progress and Applications
This chapter is dedicated to Christian Benoît, who almost single-handedly established visible speech as an important domain of research and application. During and after his residence in our laboratory for the academic year 1991–92, Christian and his endearing partner Elisabeth were an important part of our lives. We shared in their marriage and the births of their two children, as well as in m...
متن کاملLimited Domain Synthesis of Expressive Military Speech for Animated Characters
Text-to-speech synthesis can play an important role in interactive education and training applications, as voices for animated agents. Such agents need high-quality voices capable of expressing intent and emotion. This paper presents preliminary results in an effort aimed at synthesizing expressive military speech for training applications. Such speech has acoustic and prosodic characteristics ...
متن کاملVisual contribution to speech perception: measuring the intelligibility of talking heads
Animated agents are becoming increasingly frequent in research and applications in speech science. An important challenge is to evaluate the effectiveness of the agent in terms of the intelligibility of its visible speech. Sumby and Pollack (1954) proposed a metric to describe the benefit provided by the face relative to the auditory speech presented alone. We extend this metric to describe the...
متن کاملTalking Heads and Hearing Impaired Persons
This paper aims at giving a brief introduction to the research area of computer animated images of faces used for helping the hearingimpaired. The focus is especially on the progress being made in the Synface project and its predecessor. Some of the basic methods are mentioned and some description of the current state of research is given.
متن کامل